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ABSTRACT: 

PURPOSE: To transfer the picture of a speaker only and to protect the 
privacy of the speaker by storing the picture to be displayed by replacing the 
background of the current picture, and processing the background picture other 
than the speaker. 

CONSTITUTION: A speaker inputs a background input key so as to stores a 
background picture to be erased in a background picture memory 14 and stores 
the picture of the speaker himself in a current picture memory 15 by inputting 
a confirmation key after displaying the picture of the speaker himself on the 
screen of a display monitor 10. In addition, the speaker stores a previously 
prepared picture to be used for replacing the background picture in a replacing 
picture memory 1 6. Thereafter, a one-chip microcomputer 1 1 executes a program 
stored in a background process controlling program ROM 17 and sends aimed 
picture element data to a telephone line after writing the picture element data 
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into a picture memory 5. Since the background of a speaker is replaced with a 
previously prepared another picture in such way, the privacy of the speaker can 
be kept and the picture of the speaker himself can be contrasted with the 
background. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] this invention relates to the virtual society realization system which offers the place of an alternating 
current of imagination [ with passage, pictorial-communication technology, and speech-communication technology ] of a 
communication network to two or more human beings 
[0002] 

[Description of the Prior Art] The teleconference with voice is realized as a conventional analogous system. Moreover, using 
pictorial-communication technology, at the so-called TV conference, among two or more points, a picture is sent, it suits, the 
picture of a television machine is divided, and the method which displays two or more screens there simultaneously, and the 
method displayed on two or more television machines of airraid correspondence are taken. 
[0003] 

[Problem(s) to be Solved by the Invention] in the above-mentioned conventional technology, an alternating current in the 
same place as the partner who wants to alternate mutually cannot be performed, and there is a problem that the number of 
points is restricted, by communication between polytopic points again 

[0004] As the purpose of this invention is whether two or more alternating human beings gathered in one place, it is to offer 
the virtual society realization system with an eye on losing human being's number of limits which the alternating current 
which led can be performed and interchange conversation and a gesture. 
[0005] 

[Means for Solving the Problem] The virtual society realization system of this invention consists of two or more terminal units 
and service center equipment connected with them through the communication line, each terminal unit The image pck-up 
equipment which picturizes the person image of the terminal user concerned, and the transmitter which inputs this user's 
voice, The input unit which inputs the control information by this user, and the sending set which transmits the 
aforementioned user's person video signal, a sound signal, and control information to center equipment, The receiving set 
which receives the synthetic video signal which the aforementioned center equipment transmits, and a mixed sound signal, It 
has the television equipment which outputs the synthetic video signal which carried out [ aforementioned ] reception, and the 
transmitter which outputs a mixed sound signal, service center equipment The source of a background image which 
accumulates two or more background video signals, and the background sound source which accumulates two or more 
background correspondence numbers, The receiving set which receives the person video signal, the sound signal, and control 
information which each aforementioned terminal unit transmits, The image synthesizer unit which compounds the person 
video signal from each aforementioned terminal unit, and the background video signal chosen from the aforementioned source 
of a background video signal, The voice mixture equipment which mixes the sound signal from each aforementioned terminal 
unit, and the background correspondence number chosen from the aforementioned background sound source, The distribution 
apparatus which distributes the aforementioned synthetic video signal and a mixed sound signal to each terminal unit, The 
control information from each aforementioned terminal unit is analyzed, and it is characterized by having the control unit 
which performs control of image composition of the selection control of the background video signal from the aforementioned 
source of a background image, and a background sound source, or a background correspondence number, the aforementioned 
image synthesizer unit, and voice mixture equipment, or voice mixture. 
[0006] 

[Function] A user's image and voice which are in front of each terminal unit are changed into a video signal and a sound 
signal by image pck-up equipment and the transmitter, and are sent out to a communication network by them, respectively, 
each of this user's image and sound signal are sent to service center equipment, are compounded with a background image and 
background sound there, and are **** about the imagination world "virtual society" -- ** Through a communication network, 
this image and voice of "virtual society" that were compounded are sent to each user's terminal unit, and are reproduced by 
television equipment and the earphone. 
[0007] 

[Example] Hereafter, a drawing explains one example of this invention. 

[0008] Drawing 1 is the conceptual diagram of the whole virtual society realization system of this invention, and terminal 
units 1, 2, and 3 being connected with service center equipment 4 through a communication network 5, and receiving service 
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of virtual society is shown. In this example, although the example of three sets of terminals is shown, this invention does not 
limit the number of terminals. 

[0009] Drawing 2 is the example of composition of each terminal units 1, 2, and 3, and consists of control information input 
units 15, such as the earphones 14, such as the television equipments 13, such as the transmitters 12, such as the image pck-up 
equipments 11, such as a television camera, and a microphone, and a display, and a loudspeaker, a keyboard, and a mouse, 
and a transmitter-receiver 16 containing a sign / decryption section 161. 

[0010] Here, the control information input unit 15 is used for the input of the following control information. 

(1) It uses for selection of "virtual society." Thereby, a user can choose favorite "society" out of two or more "virtual society" 
prepared for service center equipment. 

(2) Use in order to choose on which position of the space which "virtual society", i.e., a background image, and background 
sound make a user image is put. By this, a user can move about in "virtual society." 

(3) When returning a user image to the user concerned, use for choosing whether it considers as an image as it is, or it 
considers as a silhouette image. 

(4) Use for the directions for expanding a specific partner's image (image of a rise), enlarging [ voice / of a partner ] 
alternatively, and there being small other voice. Conversation with a specific partner is attained by this. 

[001 1] Drawing 3 is the example of composition of service center equipment 4. The transmitter-receiver 41 containing the 
sign / decryption sections 41 1, 412, and 413 for multiple channels (this example three channels), the image synthesizer unit 42 
which compounds two or more video signals, the image distribution apparatus 43 which distributes a synthetic video signal to 
a multiple channel, and two or more sound signals the voice mixture equipment 44 to mix, the voice distribution apparatus 45 
which distributes a mixed sound signal to a multiple channel, the source 46 of a background image which accumulates two or 
more background video signals, the background sound source 47 which accumulates two or more background sound signals, 
and the positional information storage 48 which stores each one of positional information for every background — and It 
consists of a control unit 49 which analyzes the control information from a terminal unit side, and controls each equipment. In 
addition, as for a video-signal bus and 440, 420 is [ a sound signal bus and 490 ] control signal buses. 
[0012] First, basic operation of this system is explained. Now, Users A, B, and C presuppose that terminal units 1, 2, and 3 
are used, respectively. Moreover, each user shall picturize against the background of the wall of monochrome solid color. As 
a color of the wall of a background, "blue" is desirable. This is for making easy to do image composition by the 
below-mentioned chroma-key processing. 

[0013] Each terminal units 1, 2, and 3 input the "virtual society" selection information with which change into a video signal 
and a sound signal each users' A, B, and C image and voice (it is called user image in which this was summarized) with image 
pck-up equipment 1 1 and a transmitter 12, respectively, and a user specifies them to be as control information from the 
control information input unit 15, and transmit these video signals, a sound signal, and control information to service center 
equipment 4 through a communication network 5 from a transmitter-receiver 16. A sign / decryption section 161 is contained 
in the transmitter-receiver 16, and it compresses in order to transmit a video signal, a sound signal, and control information 
efficiently. 

[0014] With service center equipment 4, the video signal which each terminal units 1, 2, and 3 transmit, a sound signal, and 
control information are received by the transmitter-receiver 41, and it decodes by each sign / decryption section 411,412, and 
413, separates into a video signal, a sound signal, and control information, and sends to the image synthesizer unit 42, voice 
mixture equipment 44, and a control unit 49 through the video-signal bus 420, the sound signal bus 440, and the control signal 
bus 460, respectively. A control unit 49 analyzes control information, chooses from the source 46 of a background image, and 
the background sound source 47 the background video signal and background correspondence number corresponding to the 
"virtual society" which the user specified, respectively, and sends them to the image synthesizer unit 42 and voice mixture 
equipment 44. Furthermore, a control unit 49 sends the positional information of each users A, B, and C corresponding to the 
virtual society concerned to the image synthesizer unit 42 with reference to the positional information memory 48. In addition, 
the value or any value beforehand specified by the user is stored in the positional information memory 48. According to each 
user's positional information, the image synthesizer unit 42 compounds each user's video signal and background video signal, 
and sends them to the image distribution apparatus 43. Voice mixture equipment 44 mixes each user's sound signal and 
background correspondence number, and sends them to the voice distribution apparatus 45. The image distribution apparatus 
43 and the voice distribution apparatus 45 distribute the picture signal compounded, respectively and the mixed sound signal 
to a sign / decryption sections 411,412, and 413. A sign / decryption sections 41 1, 412, and 413 encode a synthetic picture 
signal and a mixed sound signal, respectively, and transmit to terminal units 1, 2, and 3. 
[0015] In each terminal units 1, 2, and 3, a synthetic picture signal and a mixed sound signal are received by the 
transmitter-receiver 16, it decodes by its sign / decryption section 161, and a synthetic video signal and a mixed sound signal 
are separated. Television equipment 13 projects a synthetic picture and an earphone 14 outputs mixed voice. Consequently, it 
can talk and the users A, B, and C who are in front of each terminals 1, 2, and 3 can alternate, as met in the same place. 
[0016] Next, various kinds of methods of realizing image composition are explained. Now, each users A and BC presuppose 
that the position is chosen so that it may stand in a line in order of A, B, and C from the left toward a background image. In 
this case, according to the directions from a control unit 49, the image synthesizer unit 42 compounds each user's video signal 
and background image by chroma-key processing, as shown in (1) of drawing 4 . In this state, if each users A, B, and C 
choose a silhouette image as the method of presentation of their image with the control information input unit 15, this control 
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information will be told to a control unit 49, and will serve as instructions to the image synthesizer unit 42. In case the image 
synthesizer unit 42 compounds each user's image and background image, it changes an applicable user's image into a 
silhouette image. In transform processing to a silhouette image, methods, such as making into black level the portion extracted 
by the chroma-key, and the method by the fixed pattern of the source of a silhouette image prepared separately can be 
considered. The synthetic image corresponding to each terminals 1, 2, and 3 in the case of being based on a fixed pattern (2) 
of drawing 4 , (3), and (4) is shown. 

[0017] Moreover, when a certain user directs to move one's position with the control information input unit 15 (for example, 
the move direction, distance, etc. are directed with a mouse etc.), this is told to a control unit 49, and a control unit 49 updates 
the positional information of the applicable user in the positional information memory 48, and considers it as the position 
instructions to the image synthesizer unit 42. [ in a background image ] The image synthesizer unit 42 moves to the position 
which had an applicable user's video signal specified according to these position instructions, and compounds with other 
users' video signal by chroma-key processing. Moreover, if the image synthesizer unit 42 is ordered expansion of the image 
and visual field of the user who a control unit 42 calculates the relative-position relation between the user to whom movement 
was directed with reference to the positional information memory 48, and other users, and approaches at this time, movement 
of a certain user's image can be followed, and a specific partner's image and visual field can also be expanded and (rise image) 
compounded. 

[001 8] Next, various kinds of methods of realizing voice mixture are explained. As now shown in drawing 4 , when Users A, 
B, and C have stood in a line in order of A, B, and C from the left, voice mixture equipment 44 adjusts each user's vocal 
sound level like this arrangement. In this case, although size-related adjustment is sufficient when a voice channel is a 
monophonic recording, in the case of a stereo, the voice distributed to right and left is adjusted. Moreover, it is made not to 
return a user's voice own [ a certain ] to the user. Furthermore, when a specific partner's image and visual field are expanded, 
only this partner's sound signal is enlarged alternatively and other sound signals are made small. These control is the 
instructions from a control unit 49, and is performed synchronizing with image composition. 
[0019] 

[Effect of the Invention] According to the virtual society realization system of this invention, as met in the same place, the 
user of a large number which are present in a remote place can talk, and can alternate in a natural form. Thus, this invention 
system gives the new system gestalt for the alternating current with people and a man. 



[Translation done.] 



